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Abstract 

The possibility of detecting double flavor violating top quark transitions t — > 
UiTji (ui = c) is explored in a model-independent manner, using the effective 
Lagrangian approach. Low-energy data, on high precision measurements, and 
current experimental limits are used to constraint the tuiH and Hr/a vertices 
and then to calculate the branching ratio BR(t — > i^t/x). If in the Standard 
Model BR(t — > UiTfi) is of the order of 10 -13 — 10 -14 , higgs-mediated double 
flavor violating top quark decays can occur with branching ratios ranging from 
10" 3 to 10" 4 for 114.4 GeV/c 2 < m H < 2m w , that is at the reach of the 
CERN Large Hadron Collider. 



1 Introduction 

Despite of the fact that the top quark is the heaviest known particle, with a 
mass comparable to the electroweak symmetry breaking scale, its dynamical 




Figure 1: Diagram for double flavor violating (DFV) top quark decay. 

behavior is rather restrictive. Within the Standard Model (SM), the top quark 
production cross section is evaluated with an uncertainty that is of the order 
of ~ 15% and top quarks are assumed to decay to a W boson and a b quark 
almost 100% of the time. Due to its exceedingly heavy mass, it is reasonable 
to expect the top to be more related to new physics than other fermions. Top 
quark physics may then serve as an important window for probing physics 
beyond the SM. Although some properties of the top quark have already been 

examined at the Tevatron© , a further scrutiny is expected at the CERN Large 
Hadron Collider (LHC), which will operate as a veritable top quark factory, 
producing about eight millions of it events per year in its first stage, and hopeful 

up to about eighteen millions in subsequent years 13. Other relevant studies 
will be realized in the next generation e + e~ linear colliders. 



2 Effective Lagrangian for the Yukawa sector 

In the SM, the Yukawa sector is both CP and flavor conserving. CP and flavor 
violation can be generated at the tree level if new scalar fields are introduced. 
Another alternative, which does not contemplate the introduction of new de- 
grees of freedom, consists in incorporating into the classical action the virtual 
effects of the heavy degrees by introducing SUl{^) x Uy (l)-invariant operators 
of dimension higher than four. A Yukawa sector with these features has the 
following structure^ HI 

Zff = -Y! j (L i *l j )-^(&*)(L i *l j ) + H.c. 

-YfjiQ&dj) - ^(&*)(Q i *d j ) + B.c. (1) 

where Y^-, L^, Qi, 3>, U, d^ and u\ stand for the usual components of the 
Yukawa matrix, the left-handed lepton doublet, the left-handed quark doublet, 
the Higgs doublet, the right-handed charged lepton singlet, and the right- 
handed quark singlets of down and up type, respectively. The ol^ numbers 



are the components of a 3 x 3 general matrix, which parameterize the details 
of the underlying physics, whereas A is the typical scale of these new physics 
effects. After spontaneous symmetry breaking, this extended Yukawa sector 
can be diagonalized as usual via the unitary matrices V l £ d ' u and y^ d > u ^ which 
relate gauge states to mass eigenstates. In the unitary gauge, the diagonalized 
Lagrangian can be written as follows: 



C Y eff = - (l + 2^-#) ( EM i E + DM d D + UM U U 



2mw 

-H(l + -?—h(3 + tt^—h)) (eQ}P r E + DQ d P R D + UQ U P R U + H.c.) (2) 

where the _M a (a = l^d^u) are the diagonal mass matrix and £" = (e, /i,f), 
5 = (d, s, 6), and £7 = (u : c,t) are vectors in the flavor space. In addition, S7 a 
are matrices defined in the flavor space given by 

V a = ^(l) 2 V£a a v£ (3) 

The above effective Lagrangian describes the most general coupling of renor- 
malizable type of a scalar field to pairs of fermions. This reproduces the main 
features of most of extended Yukawa sectors, as the most general version of the 

two-Higgs doublet model (THDM-III) © and multi-Higgs models that com- 
prise additional multiplets of SUl(2) x Uy(l) or scalar representations of larger 
gauge groups. Our approach also cover more exotic formulations of flavor vio- 
lation, as the so-called familons models ^ or theories that involves an Abelian 

flavor symmetry©. Results, presented in this paper, are then applicable to a 
wide variety of models that predict scalar-mediated flavor violation. 



3 The decay t — > i^r/i 



The branching ratio for the 3— body decay t —> UiTji is calculated using the gen- 
eral couplings t — > UiH and H — > r/i, obtained using the Effective Lagrangian 

technique (for further details see's))): 



Br(t UiH) = 
Br(H r/i) = 




These two expressions have been obtained ignoring the U{ and the muon masses. 
Now, in order to evaluate the branching ratio Br(£ — > i^r/i) = Br(t — > UiH) x 
Br(H — > r/i) we need to calculate the following two terms: |^ n ^| 2 an d |^ r/i | 2 . 




Figure 2: a) Diagram contributing to the magnetic and electric dipole moments 
of the fi fermion; b) diagrams contributing to the l\ — > Ijj decay. 

4 Bounding the tUiH and Hrji vertices 

An estimate of the size of |^ n ^| 2 and |^ T /i| 2 parameters is needed. Although 

they have been already estimated before, by means of the Cheng-Sher ansazt® 

or with other similar assumptions , we will resort to the available low-energy 
data, in order to be more independent from any extra assumption. A constrain 
on the l^n^l 2 parameter can be obtained, from the low-energy data, through 
one-loop or higher order effects. We will examine the contribution to the tUiH 
vertex to the proton and neutron magnetic and electric dipole moments (see 
Figure [2] a). The contribution of the fifjH vertex to the magnetic and electric 
dipole moments of the fi fermion have been calculated and the electromagnetic 
dipoles of fi can be written as follows: 

ai = _Q^ Re {V$ j )g{x i ), d z = -jB{^ym(^) g ( Xj ) (6) 

We now are in position of using low-energy data to bound the |^ n J 2 and 
|^r/i| 2 parameters. 



4.1 Bounds on \£ltu x \ 2 

In order to bound Re(Q^ u ) we used the available precision measurements on 
the proton and neutron magnetic dipole moments. We used the experimental 
uncertainty on the proton magnetic dipole, as it is the most restrictive. Thus, 

the contribution of the tuH vertex must be less than this uncertainty: 

\Aa^ xp \ < 2.8 x 1(T 8 (7) 
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Figure 3: a) Behavior of b) fi^ ; as a function of the Higgs mass. 

In order to constrain the Im(Q^ u ) term, we used the very stringent experimental 
limit coming from the neutron electric dipole moment : 



\d n \ < 2.9 x 10~ 2b e.cm. 



(8) 



The p and n magnetic and electric dipole moments, respectively, are related 
with those of their elementary constituents through the following expressions: 



3 ad ~3 as ' 



4 1 

d n = 7^d d — -d y 



(9) 



Assuming that the new physics contributions to a p and d n arise exclusively 
from the quark u, as in this case fj — t and assuming, as usual, « m u « 
m n /3 « m p /3 we finally get: 



|ii>e(tt 2 J|<(54^ 2 ) 



Aa Exp 



x t x p g{x t ) 



v e 



x t g(x t ) 



(10) 



As in this case |Jm(0| u ) << |i?e(^ 2 n )| (as matter of fact for m H = 100 GeV/c 2 
we have |i?e(^ 2 n )| < 6 x 10 -3 and \Im(Q^ u )\ < 10 _T ) we can write: 



\n tu \ 2 < (54^ 2 ) 



AaS xp 



(11) 



x t x p g(x t ) 

In Figure [5J a, we show the behavior of |£~^ n | 2 as a function of the Higgs mass. 
4.2 Bounds on \Q T/Jl \ 2 

The best experimental limits on the \i anomalous magnetic moment, and on 
the electric dipole moment are : 



\Aa% xp \ < 5.4 x HT 10 , 



\d% xp \ <3.7x 10- 19 e. 



cm. 



(12) 
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Figure 4: Branching ratio for the t — > UiTfi decay as a function of the Higgs 
mass. 



In this case we obtain: 

|ife(fi* )| < (87T 2 ) 



Aa E X p 



|j m (0^)|<(167r 2 )(^) 



x r #(x r ) 



(13) 



100 



This time we have \Re(Q 2 u )\ < \Im(Q 2 u ) (as matter of fact for run 
GeV/c 2 we get \Re(Ql)\ < 3 x 10~ 4 and \Im(Q 2 TfJ )\ < 2). In order to sim- 
plify the analysis we will assume that the leptonic Yukawa sector is also CP- 
conserving, then we can write: 



n 2 < (stt 2 ) 



Aa Exp 



In Figure [3jb, we show the behavior of Q 2 ^ as a function of the higgs mass. 



(14) 



5 DFV top quark decays at LHC 

We are now able to evaluate the branching ratio for the decay t — > i^r/i as a 
function of the higgs mass: Br(t — > UiT/i) = Br(t — > U{H) x Br(H — > r/i). The 
result, given in Figure [IJ shows that Br(£ — > i^r/i) ranges from 10 -3 to 10 -4 
for a higgs mass between 114.4 GeV/c 2 and 2mw 

LHC will be the ideal machine for investigating the characteristic of the heaviest 
quark and its role in the SM; with an NLO production cross-section of about 830 
pb, 2 top-pair per second are expected and more than 10 million per year at low 
luminosity conditions of 2 x 10 33 cm -2 s -1 . If B represents the branching ratio 
for the higgs mediated double flavor violating top quark decay, B = Br(£ — > 
UiTfi) , and if we assume no other significantly accessible decay channels, either 



m H (GeV/c 2 ) 


114.4 


130 


150 


160 


170 


Cross section [fb] 


122. 


97. 


46. 


20. 


3. 



Table 1: Cross section times the branching ratio for the LS tt decay: tt — > 
IL^^UibrhVi (£ = e, n). 

than the SM and the DFV, we will have: Br(£ -> Wb) = 1 — B. A ti pair 
can then decays as follows: a) purely SM decays (SM-SM), where both the 
top quarks decay into Wb (Br(ti)\sM = (1 - #) 2 ); b) mixed SM-DFV decays, 
where one top will decay into Wb and the other into Ui fir (Br(ti)\sM-DFV = 
2B(1-B)); c) purely DFV decays (DFV-DFV), in this case both the top quarks 
will decay into Uijir (Br(ti)\DFV = £> 2 ). Because a purely DFV decay is 
strongly suppressed, we will focus only on SM-DFV top quark decays. As in the 
channel ti — > UiT/aWb there is no charge correlation between the \i and the W, 
if the W decays leptonically (W — > Ivi) it is possible to have both like-sign (LS) 
and opposite-sign (OS) final states: /i ± ^ ± and /i ± ^ T . On the other hand, the 
r lepton can decay hadronically with a probability around 65.5 %, producing 
a r-jet containing a small number of charged and neutral hadrons. When the 
momentum of the r is large compared to the mass a very collimated jet is 
produced. At LHC center of mass energy, for a transverse momentum Pt > 50 
GeV/c, 90% of the energy is contained in a cone of radius R = ^Arj 2 + A$ 2 = 
0.2. Hadronic r decays have low charged track multiplicity (one or three prongs) 
and a relevant fraction of electromagnetic energy deposition in the calorimeters 
due to photons coming from the decay of neutral pions. In Table 1 we show 
the expected ax BR for the LS ti decays: ti — > ^t^Uibr^Vi. We then look 
for ti final states, containing a tau lepton decaying hadronically (r^) and two 
LS leptons: ti — > /i ± ^ ± w^r/ l ^ {I = e, ji). Events are selected requiring the 
presence of at least two jets (including the 6-jet), a /i, another lepton (e or /i 
with the same sign of the first /i), one tagged r-jet, one tagged 6-jet and missing 
transverse energy. The two LS leptons are required to have pt > 20 GeV/c 2 and 
r] < 2.4. Jets are reconstructed with a cone size of R = y (A77) 2 + (A</>) 2 = 0.5, 

a trasverse energy of > 40 GeV within a fiducial volume of |?7| < 2.4. The 
b-jets are tagged and required to pass the same kinematic cuts as those applied 
on the jets. The presence of r, in the events, is guaranteed by tagging the 

r-jets A further cut on the transverse energy of the r-jet, is applied in 
order to further suppress the background. Using the first 30 fb -1 of data, it 
will be possible to exclude, at 95 % C.L., DFV top quark decays mediated by 
a higgs with a mass up to 160 GeV/c 2 . 

6 Conclusions 

In this paper we studied the possibility of detecting double flavor violating top 
quark decays t — > U{ \i r in a model-independent manner using the effective 
Lagrangian approach. A Yukawa sector that includes all the SUl(2) x f7y(l) 



invariant operators of up to dimension six was proposed and used to construct 
the most general renormalizable flavor violating qiq^H and Hlilj vertices. Low- 
energy data were used to constraint the tUiH and Hr/a couplings and then used 
to predict the double flavor violating decay t — > UiT/a. It was found that this 
decay has a branching ratio of order of 10 -3 — 10 -4 for 115 GeV/c 2 < ra# < 
2mw Considering that LHC will operate as a veritable top quark factory, by 
using the first 30 fb _1 of data it will be possible to exclude, at 95% C.L., DFV 
top quark decays up to a higgs mass of 160 GeV/c 2 . 
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